ENTROPY AND CHAOS IN THE KAC MODEL 

E.A. CARLEN, M.C. CARVALHO, J. LE ROUX, M. LOSS, AND C. VILLANI 

Abstract. Wc investigate the behavior in N of the A^-particle entropy functional 
for Kac's stochastic model of Boltzmann dynamics, and its relation to the entropy 
function for solutions of Kac's one dimensional nonlinear model Boltzmann equa- 
tion. We prove a number of results that bring together the notion of propagation 
of chaos, which Kac introduced in the context of this model, with the problem of 
estimating the rate of equilibration in the model in entropic terms, and obtain a 
bound showing that the entropic rate of convergence can be arbitrarily slow. Re- 
sults proved here show that one can in fact use entropy production bounds in Kac's 
stochastic model to obtain entropic convergence bounds for his non linear model 
Boltzmann equation, though the problem of obtaining optimal lower bounds of 
this sort for the original Kac model remains open, and the upper bounds obtained 
here show that this problem is somewhat subtle. 



August 22, 2008 

Contents 

1. Introduction [l 

2. Asymptotics of the restricted tensor product 17 

3. Asymptotic upper semi-continuity of the entropy 22 

4. Convergence of marginals 27 

5. From microscopic to macroscopic entropy 30 

6. Generahzation to unbounded densities 32 

7. Entropy production bounds 34 
Appendix A. An entropic Local Central Limit Theorem 38 
References 47 



1. Introduction 

LL The origins of the problem to be considered. In a remarkable paper [16] 
of 1956, Mark Kac investigated the probabilistic foundations of kinetic theory, and 
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defined the notion of propagation of chaos, which has since then developed into 
an active field of probability. 

Kac introduced the concept of propagation of chaos in connection with a specific 
stochastic process modeling binary collisions in a gas made of a large number N of 
identical molecules, and he was particularly concerned with its rate of equilibration; 
i.e., of its approach to stationarity. 

While his ideas concerning propagation of chaos had an immediate resonance 
and impact, this was not the case with the issues he raised concerning rates of 
equilibration. These had to wait much longer for progress and development, as we 
shall relate below. In this paper, we bring these two lines of investigation back 
together, proving several theorems relating chaos and equilibration for the the Kac 
walk. 

1.2. The Kac walk. We begin with a precise description of the Kac walk as a 
model for the evolution of the distribution of velocities in a gas of like molecules 
undergoing binary collisions. For simplicity, Kac assumed the gas to be spatially 
homogeneous, and the velocities Vj (1 < j < N) to be one-dimensional. The latter 
assumption is incompatible with the conservation of both momentum and kinetic 
energy, so Kac only assumed conservation of the kinetic energy E, where 

N 

with m denoting the mass of the particle species, and vj denoting the velocity of the 
jth particle. 

The natural state space for this system (i.e., state space for the walk) is the sphere 
S^^^{^y {2/m)E) C M^, the (A^— 1) -dimensional sphere with radius ^ {2/m)E. For 
the sequel of the discussion, let us choose units in which the mass of each particle 
is 2. Then the total value of the kinetic energy is N, so that the state space is 
S^~^{^/N), and each particle has unit mean kinetic energy. Let V = (fi, . . . ,vn) 
denote a generic point in S^~^{\/N). 

Here is how to take a step of the Kac walk: First, randomly pick a pair {i,j) of 
distinct indices in {1, . . . ,n} uniformly from among all such pairs. The molecules i 
and j are the molecules that will "collide" . Second, pick a random angle 6 uniformly 
from [0,27r). Then update V = {vi, . . . ,viy) by leaving Vk unchanged for k ^ 
and updating velocities Vi and Vj by rotating in the Vi, Vj plane as follows: 



Vi,Vj) I [cos u )Vi — [sm u )Vj, [sm u )Vi + [cos t/ )Vj 
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Let Rij^y denote the new point in 5^ ^(-\/iV) obtained in this way. This process, 
repeated again and again, is the Kac walk on S^~'^{-\fN). 

Associated to the steps of this walk is the Markov transition operator Qtv on 
L'^ [S^ ~^ {\fN) , da^ ) where o"^ is the uniform probability measure on ^^"^(V^)- 
(This notation shall be used throughout the paper.) 

If Vj denotes the position after the jth step of the walk, and (p is any continuous 
function on S^~^{-\/N), the transition operator Qat is defined by 

From the description provided above, one finds that 




It is easily seen that is the unique invariant measure. 

A closer match with the physics being modeled is attained if the steps of the walk 
arrive not in a metronome beat, but in a Poisson stream with the mean wait between 
steps being This "Poissonification" of the Kac walk yields a continuous time 

process on S^~^{-\fN). Since Qa^ is self adjoint on L'^{S^~^{-\fN), dcr^), this process 
is reversible, and so if the law /iq of the initial state Vq has a density Fq with respect 
to 0"^, then for all t > 0, the law of Vt has a density F/^ with respect to a^, and 
Fl^ is the solution to the Cauchy problem 

(1) ^F^ = LmF^ with limF,^ = Fn^ 

where = N{Qi^ — I), and I is the identity operator. This equation is known as 
the Kac master equation, which is nothing other than the Kolmogorov forward 
equation for the continuous time Kac walk. The solution is of course given by 

(2) Ft = e'^^Fo . 

Since V — > Rij,e is a rotation, it follows that for each positive integer k, Q]\f 
preserves the subspace of L^(S'^~^(V^), da^) consisting of spherical harmonics of 
degree no greater than k. Hence, all of the eigenfunctions of Qn are spherical 
harmonics. Since the constant is the only spherical harmonic that is invariant under 
rotations, 1 is an eigenvalue of Q of multiplicity one. 

Therefore, for any initial data Fq in L'^{S^~^{^/N),da^), the solution Ff = 
qLnj?n q£ ^Yie Kac master equation satisfies 

(3) hm Ff = l. 

t—>oc 
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We refer to the invariant density 1 as the equilibrium, and the process of approaching 
this hmit as equilibration. 

The rate at which this hmit is achieved is physically interesting for reasons that 
will be explained shortly. But apart from its physical motivation, the problem is 
quite interesting on purely probabilistic grounds: While the subject of quantifying 
the rate of equilibration for random walks on large discrete sets has been vigorously 
developed in recent years, much less has been done in the case of continuous state 
spaces of high dimension, and the Kac walk is a very natural example. 

Kac proposed to investigate the rate of equilibration for his walk in terms 
through the spectral gap of Ljy: Define 

Atv = sup { - (v?, LN(f) : {if, 1) = and (v?, ^) = I } 

where the inner products are taken in L'^{S^~^{^/N),da^). In his paper [16], Kac 
conjectured that liminfAr_,oo Aat > 0. 

Since one already knows that the eigenf unctions oi are spherical harmonics, 
this may seem like a trivial problem. In fact, it is very easy to guess the exact value 
for Atv and the corresponding eigenf unction. Indeed, it is natural to suppose that 
the eigenfunction must be a simple symmetric, even polynomial in the velocities Vj. 
The simplest such thing, Yl!j=i'^'^^ simply a constant on S'^~^{-\/N), so one might 
try 

N 

i=i 

(The constant being subtracted to ensure orthogonality to 1 can be easily computed; 
see [7], and this is indeed a spherical harmonic.) Physical reasoning, based on lin- 
earizing the Boltzmann-Kac equation to be discussed shortly, gives further evidence 
that (y9gap should in fact be the gap eigenfunction. Using this as a trial function, one 
readily computes what should be — and does turn out to be — the value of A^v: 

However, while one can explicitly compute as many eigenvalues as one wants to, 
there is no monotonicity argument to rule out the proposition that the gap eigenvalue 
might come from a spherical harmonic of large degree. 

Kac's conjecture that liminfAr_»oo Aat > was first proved by Janvresse [15]. Her 
method did not yield the exact value for A^r. The first proof that (jl]) is actually 
correct was given in [7]; see also [20] for a different approach. For a treatment of 
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related problems, including physical three-dimensional momentum preserving colli- 
sions, see [5] and [TU] , 

These results enable us to quantify ([3]) as follows: 

for all and t. While the exponent is uniform in A^, the shortcoming of this result 
will be familiar to many probabilists who have worked on rates of equilibration: For 

natural sequences of initial data {Ff^}^^^}, it will be the case that 

ll-^0^llL2(5~-i(VJV),df7^) - 

for some C > 1. Therefore, one still has to wait a time proportional to A'^ before the 
bound starts providing evidence of equilibration. 

Even worse, the badly behaved sequences of initial data mentioned above are 
exactly the ones of primary physical interest — the chaotic sequences, in which 
for large the coordinate functions Vj are "nearly independent and identically 
distributed" under the law /i^^^ = Ff^a^ . 

1.3. Kac's notion of chaos. To state the precise definition, we first introduce some 
notation that will be used throughout the paper: Given any probability measure /i'-^^ 
on S^~^{\/N), and any positive integer k < N, let Pk{fJ,^^^) denote the marginal 
measure of fx^^^ for the first k velocities. In formulas: whenever A is a Borel subset 
of M.^ 

Pfc(/"))[A]=Ai(^)[{(^i,...,t;,,)eA}]. 

In the sequel, we only consider symmetric measures, so there is nothing particular 
in considering the first k velocities. Chaos means that Pkl^^^^ is well approximated 
by 11®^, a distribution of k independent particles when A^ is large. Here is a more 
precise definition: 

Definition 1 (chaos). Let /i be a given Borel probability measure on M. For each 
positive integer A^, let /i'-^-' be a probability measure on ^^"^(V^). Then the 
sequence of probability measures {yU^^^jTvgN is said to be yU-chaotic in case: 
(i) Each /i(^) is symmetric under interchange of the variables Vi,...,vn] 

(a) For each fixed positive integer k, the marginal PkfJ'^^^ of fx^^^ (marginal on the 
first k velocities) converges to the /c-fold tensor product /x®^, as A^ — ^ oo, in the sense 
of weak convergence against bounded continuous test functions. That is, whenever 
x{vi, ■ ■ ■ , Vk) is a bounded continuous test function of k variables, then 

(5) / x{vi,- ■ ■ ,VK)dfi'^^\vi,- ■ ■ ,vn) — > / x{vi,--- ,Vk)dn{vi) ■■■ dfi{vK). 

I Af— >oo / 
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Property (ii) says that /i(^) is well approximated by (Pi/i*^^-')®^ as ^ oo, in 
the weak sense of convergence against test functions depending on a finite number 
of variables. 

Besides being archetypal, the following well-known example will play an important 
role in this paper. It has quite an ancient history, going back — at least — to Mehler 
[21] in 1866. For a more recent reference, see [22] 



Example 2. Let 

(6) 7(^7 

Then, {c 
putation 



_ 2tx 

Then, {cr^}N£n is ''^{v)dv chaotic. Indeed, this follows easily from the explicit com- 



(7) P.."=(l-^j - ^^^J^A. where IS^, - ^ , 

and where the k-dimensional Lebesgue measure. 

Now, let / be some probability density on M, and (with the same notation as in 
the above example) suppose that {F^a'^}^^^^ is an f{v)dv chaotic family. For each 
N, let F'^{t, ■) denote the solution of ([1]) at time t, starting from the initial data F^. 
The main result that Kac did prove in [16] is that for each t > 0, ■)(j^}7vgN is 

still a chaotic family; this property is referred to as propagation of chaos, indeed, 
{F^ (t, ■)a^}]\f^n is f{t,v)dv chaotic, where f(t,v) is the solution of the following 
Cauchy problem: 

7(0,-) = /; 



2\ 2 I cN-~k~l 



%^tM = ^ I I f{v'.t)f{v:,t) - f{v,t)f{v^,t) 



dv^ d6 , 



and 



v' = {cos6)v — (sin^)?;^,; t>^ = (sin6')f + {cos6)v^ . 

This nonlinear equation is a model Boltzmann equation, which we shall call the 
Boltzmann-Kac equation (as opposed to the Kac master equation). The qua- 
dratic nonlinearity on the right is a reflection of the fact that Qn models a bi- 
nary collision process, and of Kac's notion of chaos: Indeed, the time derivative of 
Pi(e*^^-F^) may be expressed in terms of a linear operation on P2F^ , and then this 
is well approximated by the tensor product / C?) / in the limit N ^ oo. 
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The program Kac set forth in [16] was to investigate the behavior of solutions 
of ([H]) in terms of the behavior of solutions of the the Kac master equation ([T]). In 
particular, concerning equilibration, 



gN ol / „,2\ (A^-3)/2 



2 \ ' 

for large N, and thus Kac's theorem can be used to relate the rate of equilibration 
in the Kac master equation to the rate of convergence in 

lim f{v,t) = -f{v) 

t—fOO 

for solutions f{v,t) of ([8]). Once this would be carried out, one would then like to 
do the same for the actual Boltzmann equation for three dimensional velocities with 
conservation of both energy and momentum. 

As we have indicated, an analysis of the rate of equilibration for solutions of 
the Kac master equation does not shed much light on the large time behavior of 
solutions of ([8]). What would do this is very natural in the context of the Boltzmann 
equation: an entropy production estimate. 

1.4. Convergence to equilibrium and entropy inequalities. If fi and z/ are 

two probability measures on a measurable space X, their relative entropy is defined 
by the formula 

H[ji\u) = [ hloghdu h ^ 



dz/' 

with the understanding that H{^\v) = +oo if fi is not absolutely continuous with 
respect to z/. In particular, 

- if / is a probability density on M, then its relative entropy with respect to 7 
(identified with a probability measure) is 

Hifh)= [ fiv)hg^dv; 
Jr 7(f) 



- if is a probability density on ^(viV), then its relative entropy with 
respect to the uniform probability measure is 

Hj.iF'') := H{F''a''\a'') = I F"" {v) logF^(^;) da'^iv). 

The well-known Csiszar-Kullback-Leibler-Pinsker inequality states that 
(9) H{fi\i^) > y-u\\ly/2, 
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where the subscript "T\^" stands for the total variation norm. 

So the relative entropy measures a deviation from equilibrium, just like the 
norm, and it is natural to try to quantify the rate of equilibration for the Kac master 
equation by studying Hj^{F^) for solutions: If Ff^ is a solution, 

^Hr^iF^ = I log(F,^)L^F,^da^ = (log(F,^), L^F,^) . 

In analogy with the definition of the spectral gap Aat, define the entropy production 
constant Ftv by 

-(log(F^),L^F^) 



TV 



inf 



where the infimum is taken over all probability densities F^ on S^~^{\/N) with 
Hn{F^) < oo. 

The entropic analog of the Kac conjecture would be that there exists a c > with 
Ftv > c for all N. This would imply that 

(10) H^{Ff) < e-^'Hr,{F^) , 
and hence that 

There is an absolutely crucial difference between this and the estimate that 
we obtained earlier, and it lies in the extensivity of the entropy. Suppose that 
{F(^}7VeN is an /o(w)dw-chaotic family of densities on S^~^{\/N). Then according to 
Kac's theorem, {F/^}7vgN is an f{v,t)dv -chaotic family of densities on 5'^^^(V^), 
where f{v,t) is the solution of the Boltzmann-Kac equation with initial data fo{v). 
Because of the near product structure of F^, one might expect that for each t, and 
large A^, 

(11) HN{Fl')^NH{f{t,-)dv\jdv) . 

It is the proportionality to that we refer to as extensivity. Since this factor of 
would appear on both sides of ffTOj) if we substituted ffTTj) in on both sides, we can 
cancel off the A^, and obtain, in the large A^ limit 

H{f{t,-)dv\^dv) < e-'''H{fodv\-fdv) . 

We could now apply ^ to this and conclude that for solutions f{y,t) of the 
Boltzmann-Kac equation, 

\\f{-,t)dv-idv\\ly<2e~''H{hdv\idv) . 
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Such a bound would be very desirable to have for the Boltzmann-Kac equation, 
and this motivates the enquiry into the exact behavior of the entropy production 
constant T^. 

It turns out that estimating the entropy production constant r^r is a much more 
subtle problem than that of estimating the spectral gap A^. Unfortunately, the 
best information that is known at present is 

There are two different proofs of this result. The first, due to Villani, can be found 
under Theorem 6.1 in [23]. (The bound 2/ (A^— 1) is what one gets from the argument 
in [21] making some simplifications that are admissible in the special case of the 
original Kac model considered here.) The second, due to Carlen and Loss, is an 
entropic adaptation of the argument used in [7] to determine the spectral gap. It 
can be found under Lemma 2.4 in [5] using Theorem 2.5 there. It was conjectured 
in [23] that these bounds are essentially sharp; i.e., that 

However, this is not so clear at present. In fact, it had remained an open problem 
whether there was even a sequence {F^} of densities for which 

with convergence at any rate at all. The following theorem settles this issue: 

Theorem 3. For each c > 0, there is a probability density / on R with Jjg^vf{v)dv = 
and J^v'^f{v)dv = 1, and an fdv-chaotic family {-F^ajTveN such that 

y -(log(F^),L^F^) ^ 
limsup < c . 

N--*oo J^Ny-r ) 

For each c, the density f is smooth and bounded, and has moments of all orders. 

Once one has this, an easy diagonal argument produces a sequence {F^jArgN 
satisfying f|T2|) . 

While this would seem to be bad news for Kac's program, it only shows that one 
cannot have a universal bound on the ratio defining Tn, valid for all probability 
densities F/v on ^^"^(v^)- Theorem [3] does not rule out the possibility that there 
is a conditional bound on this ratio, holding for all F^ in an /-chaotic family with 
some condition on /. 
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Indeed, we shall see that the densities / used to prove Theorem [3] have a fourth 
moment that diverges as c tends to zero. As far as we now know, Theorem [3] 
might become false under the additional assumption of a fixed bound on the fourth 
moment of /. This would be very interesting since bounds on the fourth moments 
are well known to be preserved by solutions of the Boltzmann-Kac equation, so such 
a condition on the initial data would propagate. 

Moreover, it is known [11] that even for smooth initial data /o with Jj^ vf{v)dv = 
and J^v"^ f{v)dv = 1, solutions f{v,t) of the Boltzmann-Kac equation can have 
\\f{-,t) — 7||li(k) approach zero arbitrarily slowly - for example, like 

1 

l+log(l + log(l + log(l + t))) ' 

or the same thing with as many logarithms as one might wish. This however can 
happen only when the density / has very long tails so that f^v'^f{v)dv just barely 
converges. A bound on the fourth moment, which would ensure good behavior of 
the tails is therefore a plausible condition to impose if one seeks a lower bound on 
the rate of convergence. 

Finally, if one modifies the Kac walk so that pairs of molecules i,j with high 
values of vf + f | run much faster, then one can prove a uniform positive lower bound 
on Fjv; see [211 Section 6]. Thus, Theorem [3] displays the subtleties that beset 
Kac's program, but it does not by any means terminate it. In fact it raises a very 
interesting question: What sort of conditional bound on might hold for the Kac 
model? But we shall not come to that in this paper; there are more basic issues to 
be settled first. 

1.5. Conditioned tensor products. The proof of Theorem [3] naturally requires 
the construction of chaotic data, and this raises the following question: 

Question 1. Let f be a probability density on M with 

(13) [vf{v)dv = , [v^f{v)dv=l, 

and finite entropy. Is it true that there is an f{v)dv -chaotic family of densities 
{F^j^veM on S^^^WN)? 

Question [1] may seem trivial at first sight, and actually was treated by Kac in a 
rather cavalier fashion. Indeed, there is an obvious procedure for generating chaotic 
initial data, which may be described as follows. 
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Suppose that /i(df) is a probability measure on M satisfying (fT3l) . Consider the 
tensor product measure /i®^ and condition (restrict) it to the sphere S^^'^{^/N). 
By the law of large numbers, Ylj=i Vj^N for large A^, almost surely with respect to 

yU*^^, so this measure is roughly concentrated on S^"^{^/N), and the conditioning 
should not modify it too much. 

An important instance where this is obviously true is the particular case when 
= 7: Then is just the uniform measure a^, and the explicit formula ([7]) 
certainly guarantees that is 7-chaotic in a very strong sense. 

But for more general data, the extent to which /i*^^ is actually concentrated on 
S^^^{y/W) is not so obvious. Assume that /i has a density /, so is the density 
of /i®^; then the restriction of to S^~^{\/N) (which is a set of zero measure) 
might just not be well-defined under the conditions f[T^ alone. Whether or not this 
is the case depends on the fluctuations of X]j=i about A^; i.e., on how well /i®^ 

is concentrated on S'^^^(V^), as measured by the variance of v"^ with respect to 
f{v)dv. Again, this will be governed by a fourth moment condition. 

In what follows we shall use the following notation: For a probability density f{v) 
on M, satisfying J f{v)v^dv = 1, Let denote the variance of under f{v)dv: 




y2 _ l)2J(^y)fly_ 



ZN{f,r):= r^da^ 



Also, define 

ISN-I(r) 

where ^^"^(r) is the sphere of radius r in R^, and is the uniform probability 
measure on that sphere. 

The technical core of our results lies in the following estimates, that can be seen 
as a version of the local central limit theorem. 

Theorem 4 (Estimates on a conditioned tensor product). With the above notation 
and under assumptions l[T^) and 

(14) [ v^f{v) dv <+oo f F < +00 

JR JR 

for some p > 1, 

(15) ^ ^ {e-'^+e(NJ,r)\ 
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where 'y^^\r) is the restriction of 'y®^ to ^(r), 

aN\u) = e 2 , 

and liniAr^oo ^{.N, f, r) = 0. 

Remark 5. It is part of that Proposition that Zpf{f, r) is well-defined, at least if 
is large enough (it remains unchanged under a modification of / on a zero Lebesgue 
measure set). 

Remark 6. We shall prove a more precise version of the theorem, with explicit 
estimates on e{N,f,r); they will be useful to extend the validity of our results to 
probability densities which do not necessarily have finite moment of order 4, or finite 
norm. Otherwise, it is sufficient to know that e{N, /, r) ^ as — oo. 

The implications of Proposition H] are best understood when recast in terms of the 
relative density of / with respect to 7; so let 

(16) Z'M,r):= [ (^Y\a^. 

Then, as a consequence of Proposition HI 

• In other words, the integral of on S'^^^{\/N) has a universal behavior - 
depending on f only through S. 

Thus, the fourth moment condition in Theorem H] is just what is required, in the 
way of moments, for the conditioning to work. What about the condition? 

This comes in as follows: As a function of r, ZN{f,r) can be expressed in terms 
of the density for V^^, where {Vj}j^n is a sequence of independent random 

variables with law f{v)dv. By Young's convolution inequality, the A^-fold convo- 
lution power of a probability density g is continuous if g lies in L^/(^^'^\ Hence 
the condition in Proposition H] is natural: It is a simple sufficient condition to 
ensure that ZN[f, r) is a continuous function of r if A^ is large enough. Interestingly 
enough, though p can be arbitrarily close to 1, a bound on the entropy is not enough 
to ensure this. This point is discussed further in the appendix where we prove the 
version of the local central limit theorem that we shall use here. 

When the conditions of Theorem H] are satisfied, we may condition the tensor 
product /U®^, with /i = fdv, to obtain a probability measure on S^~^{^/N): 
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Definition 7 (Conditioned product measures). Given a probability density / on M 
satisfying the hypotheses of Proposition HI and fi{dv) = f{v)dv, we define the cor- 
responding family of conditioned product measures, denoted { [/^'^^]5iv-i(//v) }a^6N, 
by 

r ^Tvi _ nf=i/fa-) ;v _ nf=i(/fa)/7fa)) ^ 



The point of this definition is that, as noted above, one might hope that the family 
{ [At®^]5iv-i(yjv) }n£N would be //-chaotic. This is indeed the case, and in a very 
strong sense, as we shall explain in the next subsection. 

1.6. Entropic chaos. The notion of chaos as originally defined by Kac is well 
adapted to his original purpose, namely, establishing a rigorous connection between 
the linear Kac master equation on the one hand, and the non linear Boltzmann-Kac 
equation on the other. However, it is not quite strong enough to draw conclusions 
about the entropic rate of convergence to equilibrium for the Boltzman-Kac equation 
from an analysis of the entropic rate of convergence for the Kac master equation. 
As we have explained above, a rigorous deduction in this direction would depend on 
having a precise version of the extensivity property (fTTl) for chaotic families. Thus 
we ask: 

Question 2. Is there a reformulation of the chaos property in entropic terms that 
is sufficiently strong that it can yield a hound on the entropic rate of convergence to 
equilibrium for ([H]) when combined with a bound on the entropic rate of convergence 
for (HD? 

As we shall see, the answer is positive: 

Definition 8 (Entropic //-chaos). Let /t be a probability measure on M, and, for each 
positive integer N , let /t*^-^^ be a probability measure on S^~^{\fN). The sequence 
{lJi^^^}Nm is said to be entropically /i-chaotic in case it satisfies conditions {i) — (ii) 
in Definition [H and in addition 



a 



(lit) lim = H{^i\-i). 

As indicated above, from the physical point of view, condition {Hi) can be thought 
of as expressing asymptotic extensivity of the entropy for an entropically chaotic 
family; it provides a bridge between the entropy of the iV-particle system and the 
entropy of the reduced system. This is reminiscent of a work by Kosygina on the 
limit from microscopic to macroscopic entropy in the Ginzburg-Landau model [17]. 
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Secondly, entropic chaos really is a stronger notion than plain chaos; it involves 
all of variables, not only finite-dimensional marginals of fixed size. There is a good 
analogy with a work by Ben Arous and Zeitouni [3] (also based on the extensivity 
properties of entropy). Their work, just as ours, uses a version of the Central Limit 
Theorem. 

Finally, once Condition (ii) is enforced. Condition (in) really means that fi^^^ 
is "strongly" close to /i®^. To understand this, think of the following well-known 
theorem: If f^^^ is a family of probability densities on M, converging weakly to 
some probability density / as iV — *■ oo, and J is a strictly convex functional, then 
automatically J{f) < liminf J(/'-^)); but if in addition J{f^^^) — J{f), then the 
convergence of f^^^ to / actually holds almost in the sense of norm, not just 
weakly. So one could define a notion of strong convergence by requiring the weak 
convergence of f^^\ plus the convergence of J(/(^)) to J(/). Such a step has 
already been taken in the definition of the "entropic convergence" used in the context 
of (deterministic) hydrodynamic limits of the Boltzmann equation by Golse and 
collaborators, in an impressive series of papers, starting with [1] and leading up 

to [n]. 

The following theorems provides an answer to both Questions [1] and [2) 
Theorem 9. Let f be a probability density on M satisfying 

jf{vydv = l j f{v)v^dv <+oo, /eL~(M), 

and let /i(dw) = /(f)df . Then {[^Jl!^'^]sN~l{^^^} n&h is entropically ^-chaotic. In 
fact, condition (ii) from the definition of chaos holds in the following much stronger 
sense: 

(17) hm i7(P,([/xn5--(v^)) k^')=0. 

Furthermore, let {/i^^-'jAreN be any family of symmetric probability measures on 
5^-i(ViV) such that 

(H) ^^(-"^"^^ I [/"'''^]5-HVlv)) 7^ • Then {/i^j^veN is entrop- 

ically fi-chaotic. 

Theorem [9] takes care of Question [1] for bounded densities / with a finite fourth 
moment, but certainly we cannot directly employ the conditioned tensor product 
construction when / does not have a fourth moment. However, using a diagonal 
argument, we shall be able to show that there does exist an entropically /dw-chaotic 
family for all finite energy, finite entropy probability densities / on M: 
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Theorem 10. Let f be a probability density on R with 

j f{v)v^dv = 1, i7(/|7) < +00. 

Then there exists an f{v)dv-entropically chaotic sequence. 

Theorem [9] has the foUowing shortcoming: One might hope that for any fdv- 
entropicaUy chaotic family {yU^^^}, and not only conditioned tensor products, one 
would have 

{ii') For any keN, lim i/(Pfc(/i(^V®^) = • 

A''^oo 

We would then include condition {ii') in the definition of entropic chaos. How- 
ever, Theorem M asserts this only when {/i*-^-*} is a conditioned tensor product. 
While the set of conditioned tensor product states is not propagated into itself by 
the Kac mater equation, probability densities satisfying condition (H) for some 
s'^-i{v^)}a^gn may well be. This leads to the following problem, for which we 
have no solution: 

Open Problem 11. Does Condition (H) in Theorem\^ also imply Condition (ii')? 
More generally, does (ii' ) hold for a larger and easily recognized class of chaotic 
sequences, larger than those constructed by means of conditioning tensor products? 

Also, as indicated above, a natural next step in the development of Kac's program 
consists in studying the propagation of Conditions (Hi) or [H) — or (ii' ) — under 
the Kac master equation. 

1.7. Final remarks. As an intermediate step in the proof of Theorem [9l we shall 
establish the following statement: 

Theorem 12 (asymptotic upper semi-extensivity of the entropy). For each N , let 
H^^'^ be a probability density on S^~^{^/N), such that /i^^-* is jji-chaotic, in the sense 
of Definition [H Then 



HifJ'l^) < liminf 



This result certainly has interest in its own right, and further explains the meaning 
of Condition [H) in Theorem [91 By the way. Theorem [12] and Theorem [10] together 
provide a proof of Remark 2 following Theorem 6.1 in [23]. (The author had at 
the time thought that this remark was obvious.) This combination of results also 
establishes a kind of F-convergence of the functionals H{-\a^)/N to the functional 
^(■|7). 
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We close our introductory discussion with some final remarks on Kac's pro- 
gram. Kac suggested that one could prove quantitative theorems on the non linear 
Boltzmann-Kac equation by means of an investigation of the linear master equation. 
At the time Kac wrote his paper, the rigorous mathematical theory of the Boltz- 
mann equation had been in the doldrums since the landmark work of Carleman [6] in 
the thirties. The suggestion of Kac to recast the problem of investigating nonlinear 
equations such as ([8]) from a probabilistic many particle point of view was made in 
the hope that this might be a better path to progress. 

However, the history of the subject has not developed as Kac had hoped. The lack 
of progress between the papers of Carleman and Kac turned out to be due as much 
to lack of attention as to the intrinsic difficulties of nonlinear equations equations 
such as ([8]). Once a new generation of mathematicians took up such equations as 
an active field of research, a well developed and full-fiedged theory emerged. And 
so far, no relevant property of the nonlinear equation ([8]) has been proved via ([1]), 
which cannot be proved by direct means. Indeed, once again in this paper, we shall 
prove lack of a uniform entropy production inequality for the Kac master equation 
(Theoreml^ through an analysis of the Boltzmann-Kac equation. 

Still, Kac's program is worth trying to push for various reasons. First, the theory 
of spatially homogeneous Boltzmann equations has reached maturity, with quite 
precise results, and specialists are now looking for very sharp statements; it might 
be that Kac's approach, thanks to its strong physical content, could be adapted to 
such refinements. Just because so far no relevant property of ([8]) has been first proved 
via ([1]) does not mean that this is cannot be done, and certainly the probabilistic 
ground is less worked-over. 

Second, it can be seen as a baby model for the much more subtle problem of 
propagation of chaos in the "true" spatially inhomogeneous Boltzmann equation. 

Finally, one might be interested in it for just historical reasons, since Kac's paper 
is one of the founding works in modern kinetic theory — and just perhaps, the 
renewed focus on Kac's ideas will yield new progress of a fundamental sort. 

1.8. Organization of the paper. In Section [2] below, we first study the asymp- 
totics of the restricted tensor product, and prove Proposition HI In Section [31 we 
establish the asymptotic upper semi-continuity of the entropy (Theorem [T^ . In 
Section |H we study the convergence of marginals, establishing in particular Condi- 
tion (ii) of Definition [1] for the restricted tensor product. Asymptotic extensivity of 
the restricted tensor product (or perturbations thereof) will be proven in Section [51 
Then, in Section [6] we prove Theorem [TOl Finally, we shall investigate entropy pro- 
duction and prove Theorem [3] in Section [71 The appendix contains the statement 
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and proof of a version of the local central limit theorem with precise quantitative 
bounds that we require in Section [21 but it also has some independent interest. 

We close this introduction by thanking Julien Michel for providing reference [13] ; 
and Alessio Figalli for his careful reading of and comments on an earlier version of 
the manuscript. 

2. ASYMPTOTICS OF THE RESTRICTED TENSOR PRODUCT 

The goal of this section is to analyze the asymptotic behavior of 

ZN{f,r):= [ r^daf 

as N ^ oo, where is the uniform probability measure on S^~^{r). 

Lemma 13 (probabilistic interpretation of ^at). Let f be a probability density on 
M, and let {Vj}j<^^ be a sequence of independent random variables with common law 



f{v)dv. Then the random variable '■= J2f=i^i^ density siy{u)du, wh 



■I 3-- 



ere 



(18) sn{u) = u--^ZnU\ v^) , 

where \S^ ^1 = vr- stands for the (N — 1) -dimensional volume of the unit sphere 

I I p^i^ J y J 

gN-i ^ ^ ^ particular case, the law ofV^ has density h{u) du, where 

(19) h{u) = ^(^fiV^) + fX-V^)). 



Proof of Lemma [73 We use the notation r = \f^vf and let E denote the expec- 
tation with respect to the uniform probability measure on 5*^"^. Whenever (yj is a 
continuous test function supported in [0, +00), a polar change of variables leads to 



f'''^v)ip{r')dv = \S^~'\ I /®^^(r^)r^-Mrda 

[0,+oo]x5'V-i 



"+00 

iN-l\ 



N-l 
U 2 



2v^ 



/ ^(n) / f{V^y,)...f{^yN)da{y) du 



SN-l 



ip{u) ( — - — u^~^ZN{f,y/u) ] du. 



□ 
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Our next theorem, which is the main result of this section, is a shghtly sharp- 
ened version of Theorem HI It provides more information on how the remainder 
terms there depend on /. In describing this dependence, we shall use the following 
notation: 

Let / be a probability density on M with finite moment of order 4, and finite 
norm for some p G (1, cxd). Define the mean kinetic energy and its variance by 



E = j f{vy dv; S = y y (t;2 - Eyf{v) dv. 

(As is in the introduction, we have chosen units in which the mass m is equal to 2.) 
Let E_, E, E, L be constants such that 

0<E<E<E<+oo; S > S > 0; UWlp <L, 

and let X4 be any nonnegative function of r > 0, such that X4(^) — ^ as r ^ 
and 

/ f{v)v^dv<Xi{r). 

(For instance, we could define X4 to be the left hand side, but in applications another 

choice, such as / f{v)v^dv may be more useful if, say, / possesses a 6th moment.) 
Jr 

Theorem 14 (asymptotics for the conditioned tensor product). With the above 
notation, define 

where S^~^{r) is the sphere of radius r in R^, and is the uniform probability 
measure on that sphere. Then, as N ^ oo, 

^^W(r) 



ZN{f,r):= r^da^ 



^M/,r) = #7("Hr)f^) 6-^^+0(1) 



where 



7W(r) 



e" 



(27r)^/2 

is the restriction 0/7®^ to S'^~^(r), 



and 0(1) stands for an expression which is bounded by a function uj{N) 0, de- 
pending only on E_, E, S, p, L and X4- 
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In particular, 

Z^if, Vn) = ^j(^\Vn) (e-^^ + 0(1)) . 

Proof of Theorem 1J_. Since (with the notation of Lemma [T3l) Vi has density h, it 
follows that Sn has density /i*^ (the A^-fold convolution product of h with itself). 
So sn = h*^ , which leads to the formula 

(20) ZM,V^)- 



^ ""5'Af"l| 



U 2 



We shall use the local central limit theorem to approximate h*^ . For that we need 
some estimates on h. First note that J h{u) udu = E and J h{u) du = E"^ + T? 
Also, 

/ h{u)u^ du = I /(f)f^dw. 

Ju>l/r Jv>l/^ 

Next, let g > 1; by convexity of t i— > t'^, and the definition of h, 



f h^{u)du<\l u-'^'^f'^i^) + f%-V^))du 



U 



-(<?-l)/2 



1 



2v^ 



{P{Vu) + f\-Vu))du 



i-Vn^)dt; < / + / f'^iv)dv. 



'[-1,1] \vr' 

If g < {2p)/ (p + 1), then, by Holder's inequality. 

On the other hand, / f^dv = ||/||^q < WfWip &s soon as g < because / is a 
probability measure. The conclusion is that there is a finite constant C{p,q) such 
that 

(21) \\h\\L'><C{p,q)\\f\\L. for all q < {2p)/{p + 1) . 

Now let g be defined by g{v) = S h{E + T,v). so that 

g{v) dt" = 1 J g{v) vdv = Q j g{v) dt" = 1 . 

It follows immediately from ( !2T!) that g lies in L'^ for some g > 1. 
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Also, g inherits from h a sort of "concentration bound" that we require to apply 
Theorem [571 in Appendix [X] 



2 



< 



2 

< — 



h{s) {s-Efds 

>T./r+E 

h{s){s^ + E^)ds 

s>Y;/r+E 

, , , J J 2 £2 + j;2 



Evidently, the quantity on the left goes to as r ^ 0, with a rate which depends 

As a conclusion, g satisfies all the assumptions of Theorem [27] in Appendix [Aj so 
there is a function A(A^), only depending on the above-mentioned bounds, such that 



and so. 



sup VA^^*'^(ViVM) -7(m) < X{N) 



sup 



u 



7 , , 
N WN 



< 



XiN) 



N 



Then, since g*^iu) = J:h*^{NE + En), we deduce 



sup 



h*^(x) 



1 



x-NE 



NT. 



< 



X{N) 



NT 



Now let us insert this bound in f[20l) and apply Stirling's formula, in the form 

r(f).y^]vMiv)2-*«(i.o(-^); 



where aj\f(u) := u 2 This results in 



VTrNa^iN) 2"f+i 



NT 



7 



u-NE 



NT 



oil) 1+0 



Now the desired expression follows easily. 
Remark 15. Consider the case when E = 1\ then 



(TV) / HT\ 



□ 



Z^{f,^N)=^^^\N) 
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Thus, after renormalization by the Gaussian density, Z]\f{f,\'N) has a nontrivial 
finite hmit as ^ oo. This was derived in the above proof by using successively 
the Local Central Limit Theorem and Stirling's formula. Actually, the latter can 
be eliminated: Since 7®^ is constant on the sphere (by the way, the Gaussian is 
the only tensor product function to satisfy this property), we can write, with the 
notation (flGll . 



and in view of Lemma [I3] this simplifies into 



the asymptotics of which can be computed by using only the Local Central Limit 
Theorem, and not Stirling's formula. Actually, this line of reasoning shows how to 
deduce Stirling's formula from the Local Central Limit Theorem. This observation 
in itself is not new (it is made explicitly in the discussion of the Local Central Limit 
theorem in [13]; see also [T9l Problem 2]). However, it is interesting to see that here 
it arises naturally as part of a physically relevant problem. 



We conclude this section with a higher-dimensional generalization of Theorem [T] 
beginning with the analogs of some definitions we made for densities on M. . Let / 
be a probability density on M'^ with finite moment of order 4, and finite norm for 
some p G (1, 00). Define 




E= f{v)\v\'dv; S = J/ {\v\^-Eff{v)dv 



Let E_, E, S, L be such that 

0<E<E<E<+oo; S > S > 0; ||/|Up < I, 
and let be a nonnegative function of r > 0, such that X4:{^) — ^ as r ^ and 

/ /(^^)|^^|^dt; < X4('^)- 

Again in the higher dimensional case, it is easy to see that ii f E for some p > 1, 
then the density h of v"^ under f{v)dv is in L'^ for some g > 1. Then we have the 
following analogue of Theorem [1] 
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Theorem 16 (asymptotics for the conditioned tensor product). With the above 
notation, define 



Zm{f,r):= / r"^da^, 



Then, as m — > cxo, 



^ ^ V2 e-- f akm{km)\ r (rf^^pi 
S (27r)— V "fcm(r^) / L 

where o(l) stands for an expression which is bounded by a function uj{m) — * 0, 
depending only on k, E_, E, S, p, L and xa- 
In particular. 



Zm{f,r) = W-^(r) e'^S^ +o(l) 



TTl(fc-E)2 



Sketch of a proof of TheoremlTSi First, one can adapt the proof of Lemma US] to 
the present case; the conclusion should be changed as follows: Sm '■= J2f=i I^P ^as 
density Sm{u) du, where 



1^' 



km—l I 



km 



Sm[U) = U 

In particular, the law of |Vip is 



^ Zmif, Vu). 



\s 



km—l I 



km 



h{u) = ^^^—^ u^-' /da^. 

Then the proof of Theorem [Ml adapts to the present case with hardly any change, 
upon replacement of by mk. □ 

3. Asymptotic upper semi-continuity of the entropy 

To motivate this section, let us recall an important property of the entropy func- 
tional. Consider a sequence of probability measures /i^ on M, converging weakly to 
another probability distribution /i(df) as ^ 00, and let v be another probability 
measure. Then 

H{^\v) < liminfiy(/i^|i^). 

Af— >oo 

In other words, the relative entropy is lower semi- continuous under weak conver- 
gence. 
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In this section, we shall show that the same property is true when the dimension 
goes to oo, and weak convergence is replaced by the chaos property. The following 
theorem is a generalization of Theorem | 



Theorem 17. Let g be a probability density on R, such that 

g{x)x'^dx = l, g{x)x^ dx < +00, g e L'^iR) (p > 1) 



define u^dv) = g{v) dv. For each positive integer N, let /x^^^ be a symmetric proba- 
bility measure on S^~^{\fN) , such that 

in the sense of weak convergence against bounded continuous functions. Then 

Hi^^W) < limmf . 

More generally, if, for some positive integer k, 

A"— >oo 

then 

k N^oo N 

The proof uses the results of Section [2], plus a duality formula for the entropy: 

Lemma 18 (Legendre representation of the H functional). Let X be a locally com- 
pact complete metric space equipped with a reference (Borel) probability measure v. 
Then, for any other probability measure fi on X , 



(22) 



i7(/i|z/) = sup jy (^d/i-log (^j e'^du^ ■ ^ e Cb{X) 



where Cb{X) stands for the space of bounded continuous functions on X . 

Moreover, one can restrict the supremum in (1221) to those functions such that 
j e^du= 1. 

We skip the proof of Formula fl22|) . which belongs to folklore (see e.g. [T8l Appen- 
dix B] for a complete proof in the case of a compact space X). As for the last part 
of Lemma [T8| it follows from an easy homogeneity argument. 



24 E.A. CARLEN, M.C. CARVALHO, J. LE ROUX, M. LOSS, AND C. VILLANI 



Proof of Theorem\T^ Let u^^^ := [l^'^^]sf^-^{^/N)■ We first consider the case k = 1. 
Let e > be given. By Lemma [181 we can find a bounded continuous function 
such that 

j e^9 = l] j ipdfi>H{fi\u)-e. 

On S^^^{VN), consider the function 

^{vi, ...,vn) = ^{vi) + ... + ^p{vn). 

By Lemma [18] again, 

The first term in the right-hand side of (!23|) is controlled by symmetry and con- 
vergence of the first marginal: 

(24) ^ / $(t;)d/i(^)(tO = / ^{v)d{Pii2^''^){v) > [ ipdfi. 



(Here we have used the continuity of ip.) 
To estimate the second term in the right-hand side of (125]) . we note that 



(25) /e*(^)d.(^)(.) = ^^(''9.VN) ^ Z'^{e-gWN) 



Since (p is bounded above, we know that e'^g satisfies the same estimates as g, which 
makes it possible to apply Theorem [TH with obvious notation. 



ZUe^'g, vT) = (e- -(-«)^ + 0(1)) = 0(1). 

Hence 

(26) hminf f-i- logZ'^ie'^g, Vn)] > 0. 
Similarly, 

Z'„(,, ViV) = 4 (e--^ + 0(1)) = + 0(1)). 

SO 

(27) jhn (llogZ;(,,v^))=0. 



iV(l-E(e'^g))^ 
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(This is where the assumption J g{x)x^ dx = 1 is used. 
The combination of fl25l) . fl26p and (1271) imphes 



hminf ^log (^j e*(")di^(^)(^0)) > 0- 

Combining this with ^IM and we find 

lin„nf^<'''"'l'-")> Ui,, 

and by the choice of ip this is no less than H{^\v) — e. Since e is arbitrarily small, 
the proof of Theorem [T71 is complete in the case k = 1. 

Now the proof for general k goes along the same lines: pick up cp = (p(vi, . . . , Vk) 
such that 

/ eV' = l; /(/^d/ifc>i/(/i,|0-^- 
Define m as the integer part of N/k. On S'^~^(-\/iV), consider the function 

$(^1, ...,Vn)= f{Vi, ...,Vk)+ ip{Vk+l, . . . , V2k) + . . . + f{v^rn~l)k+l, Vmk) ■ 

Then fl2^ is unchanged, and fl2^ transforms into 
(28) 

1 / $(^Od/i(^)(^)= (^) / ¥^(t;)d(n/i(^))(t;) — / pdf^k. 

Also equation fl27|) is unchanged; but there is a subtlety with equation fl26|) . which 
cannot be directly interpreted in terms of constrained tensor product. So write 
= km + q{0<q<k — 1), and 

X = {y,z), y = {Xi, . . . ,Xkm), Z = [Xkra+l, ■ ■ ■ ,Xn)- 

By using polar changes of variables (successively for x and y) and a test function 
argument, we see that 



/ F{y,z)da^{y,z) 
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where the integral is restricted to the region \z\ < r. Then we recognize that 
So in the end 

(29) / e*^?®^da^ 



where the integral is restricted to the region \z\ < V N . To conclude along the lines of 
the case /c = 1, it is sufficient to show that the expression (129|) is uniformly bounded 
as N ^ oo {(fi and g being fixed). Since there are a finite number of possible values 
for q, we might also assume that q is fixed. 
Now use the formulas 



to estimate (1291) : after some computations, one finds 

0(1) f A fg^ 

e' g^' OCT' ^ - 
Next, if \z\ < VN, then (1-^1 < e"'^'', so 



(30) / e%-d."<^/ (i-^) 



\Z 



2- 



< e 2 I iv y'l, , . /T7 = e 2 AT ;i 



Plug this in fl30|) to obtain 

/ e*^7^^dcr^<0(l) / e^(^)^7^^(z)d^ 

<0(l)e^+2 /" ^®5(2)d2 = 0(1). 
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With this estimate in hand, there is no difficulty to conclude the proof of Theorem [T71 

□ 

4. Convergence of marginals 

This section is devoted to the convergence of finite-dimensional marginals under 
various entropy assumptions. In the ffist subsection, we show that (with loose nota- 
tion) the natural condition = o{N) implies that yu'-^-' is /i-chaotic. In 
the second subsection, we show that at least in the case when /i(^) is the constrained 
tensor product, then the convergence of the finite-dimensional marginals holds in a 
stronger sense, namely in relative entropy (and as a consequence in total variation). 

4.1. Prom entropy estimates to chaos. 

Theorem 19 (Entropic closeness to the constrained tensor product implies chaos). 

Let u{dv) = g{v) dv be a probability measure on M, such that 

J g{v)v'^dv = 1, J g{v)v^dv < +00, g e L^iR) (p > 1), 

and let v^^^ = [i^®^]5]v-i(^) be the constrained tensor product of u on S^~^{VN). 
Let further /i*^^-' be a symmetric probability measure on S^^^{^/N), such that 

N^oo 

Then, /i^^-* is u-chaotic. More precisely, for each k, the marginal PklJ^^^^ converges 
weakly (against bounded continuous test functions) to u^'' . 

Proof. We ffist claim that, for given k, the sequence PkfJ^^^^ is tight. Indeed, let m 
be the integer part of N/k, then since N = J |xp d/i''^-*(x). 



N> l{xl + ...+xl) d/x(^) {x) + ...+ I (x?^_,),+, + ...+xl,) d/i(^) 



and by symmetry the latter expression .s m f d(ft,<"))(.). It follows that 

TV 

IxP d(PfcyU*-^'')(x) < — which converges to A; as ^ oo. 
m 

By Prokhorov's theorem, Pkfi^^'' converges, possibly up to extraction of a subse- 
quence, to some probability measure /i^ on M'^. From Theorem [T71 

k Af^oo N 
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It follows that /ifc = i/^'', SO the whole sequence PkjJ'^^^ does converge to z/*^^, and 
(/i*^^'') is indeed i/-chaotic. □ 

4.2. Marginals of the constrained tensor product. As an obvious consequence 
of Theorems fTTl and fT9l the constrained tensor product jj^^^ of /i is itself /i-chaotic. 
We shall show in this section a stronger result: Pkl^^^^ converges to /i®'"' in total 
variation, and even in relative entropy. 

Theorem 20 (Property {ii') for the constrained tensor product). Let fi{dv) = 
f{v)dv be a probability measure on M, such that f G L^(M) for some p > 1, and 
J^v'^f{v)dv < oo. Let n^^^ = [A*'^'^]siv-i(//v) be the restricted N-fold tensor product 
of n- Then for all positive integers k, 

lim i7(Pfc/i(^V^') = . 

N~*oo 

Proof Let [/®^] 

5iv-i(v/7V) stand for the density of the constrained tensor product, 
with respect to the uniform probability measure o"^. Fix any integer k. Then for 
all N sufficiently large. 

If i.-.,v7v, = [Uui^yii",)) j 

With the notation = X]j=i "^j ' ^^i^ expression can be rewritten as 

k 



Therefore, P. = ( n(/(-.)/7(-.)) ) ^""fifL^^ ^^(-")- 

\j=l J ^TvU'ViVj 

As a consequence, with Ck standing for the /c-dimensional Lebesgue measure, 

H{Pk^^n^^^')= [ (log ^^^y^) - log d(P,/iW) 
jjjfc aLk 
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From Theorem [H] and some computation 
log 



and so 



In other words, 

(31) H{P,^^^''^\^^^^ 
where 



(32) 



log 



Now let us derive some estimates on \E'jv By direct computation, 



(33) 



(P.^^)(dy) 



\S 



\y\ 

N 



2\ (N-k-2)/2 



dy. 



jYfc/2|5'jv-i| 

By an application of Stirling's formula, and some computation again. 



(34) 



d(Pfca 



d7' 



■{y) < (l + o(l))e— 



'|<v'Af 



<(l + o(l))e 



k+l 



0(1). 



On the other hand. Theorem [H] implies that the ratio of the Z' terms in fl32|) is 
uniformly bounded. We conclude that N{y) itself is bounded above, uniformly in 
N and y. This makes it possible to apply the dominated convergence theorem, in 
the form 



Af->oo 



limsup / ^N{y) f®\y)dy < / ( limsup^jv(2/) ) /"""(y) 



Af-»oo 



ff^ki 



It follows from fl3ll) and Theorem [T^ that for any ?/ G M'^, 

^]v-fc(/, \/A^^) 



^^v-fc(/,VAr) 
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as — > cxD. So lim\I/Ar(y) = 0, and as a consequence limsup / '^Niv) f^^iv) < 0, 

N-^oo J 

SO by fl3Tll , lim sup H{Pki2^^^ l/i®'') < 0. This concludes the proof of Theorem [201 □ 

TV— >oo 

5. From microscopic to macroscopic entropy 
Now comes one of the main results of this paper. 
Theorem 21. Let f be a probability density on R, such that 

jf{v)v^dv = l j f{v)v*dv<+oo feL" 

Let u{dv) = f{v)dv, and let u^^^ = [i^'^^]5iv-i(^) be the constrained N-fold tensor 

product of v. For each N, let further /i*^^^ be a probability density on S^~^{\/N) 
such that 



0. 



Then 

H{v\l). 



N~*oo 

Remark 22. During the proof, we shall show that the convergence of the marginals 
Pkl^^'^^ actually holds true in the sense of weak convergence against bounded mea- 
surable functions (as opposed to bounded continuous functions). We do not know 
whether it holds true in the sense of, say, total variation. 



Proof of Theorem First we write 



H{^^^^^\v^^^) + /log(^) d/.(^) - log(Z;,) 
o{N) +N j \ogf{v,) d/i(^)(^) - j log7^^d/i(^) - logZ;.(/, v^) 
o(A^)+A^ j log/(t;i)d/x(^)(^) + A^^^^^°^^^''^ 
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In the next to last step, we have used Theorem [TU which imphes that log Z'j^{f, \/N) 
converges to a positive limit as ^ oo, and so may be absorbed into the o{N) term. 
Also, in the last step we have replaced 7®^ by its explicit expression on S^^^{^/N). 
Then, after division by TV, we find 



[ log/K)d(Pi/x(^))(t;i) + 
Jm 



1 + log(27r) 



oil] 



For any 5 > 0, we have therefore 



(35) ' < J \og{f{v,) + 6) d(Pi/i^-^)(t.O + [—^^ ) + o{l). 

Assume for the moment that / is continuous. Then log(/ + 6) is a bounded 
continuous function, so we can pass to the limit, using the weak convergence of 
Pifi^^^ to u{dv) = f{v) dv (Theorem [T^ . and deduce 

H{fx(^)\a^) ^ f /l + log(27r)\ 

(36) hmsup — < / f{vi) \og{f{vi) + 6) dvi + I 1 . 

By dominated convergence, we can now let 5 — > 0, and recover 

i/(/iW|a^) ^ f ^. ^, ,^ /l + log(27r) 

hmsup -< f{vi)logf{vi)dv^+' 



N 



Since J f{v)v^dv = 1, it is easy to check that the latter expression coincides with 
H{i'\'-f). The conclusion is that 

(37) Hmsup ^ J ' <H{u\^). 

N-*oo 

On the other hand, by Theorem [T71 applied with g = ""f, 

(38) //(/i|7)<liminf:^^^^!^^. 

N^oo iV 

The combination of fl37j) and fl38l) concludes the proof of Theorem [2TJ □ 

Now, let us prove the more general statement alluded to in Remark [221 We start 
again from ( 135|) . and deduce that 

H(fi^^Ma^) , „ /l+log(27r)\ 

' <log||/|U^ + ( +o(l). 
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which is bounded as — oo. This bound can be combined with the exact (not 
asymptotic) inequahty 



k - N ' 

to obtain 

/7(Pfc/i(^)|PfeO=0(l). 

The inequahty fl39|) is a generahzation of the subadditivity inequahty on from 
[9], which gives the k = 1 case. The generahzation to higher k can be found in [2], 
in Example 1 under CoroUary 5 there. 

Next, by the same kind of computation as in the beginning of the proof, 

HiP,^^(^^\^^') = HiP,^^^^^\P,a^) + J log d(P,/i(^)). 



It follows by (IMD that 

i7(P./.W|7^') < i/(P,/i(^V,a^) + C, 

where C is some constant depending only on k. In particular, H{PkjJL^^'>\'y®^) is 
bounded as ^ oo. The conclusion is that the marginals Pkj^^^"^ have hounded 
relative entropy with respect to 7*^^^, uniformly in N. It follows by the Dunford- 
Pettis compactness criterion that the densities fjf^^ of Pkfi^^'' constitute a compact 
set in L^(]R'^), equipped with the weak topology. Since this family converges weakly 
to Z®'^ as — * 00, actually the limit 



holds true for all bounded measurable function not necessarily continuous. The 
conclusion follows by the same arguments as before. 

6. Generalization to unbounded densities 
In this section we use a density argument to derive Theorem [10] from Theorem 

Proof of Theorem\T^ If / is bounded and has a finite fourth moment, we can simply 
use the tensor product construction. Otherwise, we define approximations to / as 
follows: If / has a finite fourth moment but is unbounded, and 5 > 0, define to 
be e'^'^/, rescaled so that has unit variance. Otherwise, if / does not have a finite 
fourth moment, let 

95 = e (/I [-1/5,1/5]) . 
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Then renormahze gs so that it is a probabihty density, and finally, make an affine 
change of variable to obtain a density that has zero mean and unit variance. Call 
this fs- 

It is easy to see that for any positive integer j, we can choose a value 6j > so 
that 



(40) 



\H{fs,h) - H{f\j)\ < 



2j 



Apply the tensor product construction with each fsj to produce the chaotic sequence 
/i^^^ By Theorem [211 



1 



AT ^t^Oi I 



N 



> 



Therefore, we may inductively define an increasing sequence of integers {iV,} by 
choosing Nj > Nj_i large enough that 



(41) 

for all N > Nj. 

Combining (HOj) and 

(42) 



N 



we obtain 



< 



2j 



i/(/.f IO-WI7) 



< 



J 



Further increasing the Nj if required, we may assume, on account of Theorem 
that for each j, 



(43) 



N > N, 



sup i/(P,<V|0 < ^ 



We are now ready to define our sequence, which we shall show to be f{v)dv- 
chaotic in the entropic sense: For each A^, define 



for k = inf : < N} . 



First, property (z) holds for obvious reasons. Next, to see that property (ii) 
holds, let (j) be any continuous bounded function on R'^. Then, by the well-known 
Csiszar-KuUback-Leibler-Pinsker inequality and (143|) . 
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for all N > Nk. Therefore, for all N > Nk 
while trivial estimates show that 



< 



lim 

<5^0 



dv 



dv 



. 



Finally, the fact that {in) holds follows easily from (l42l) . 



□ 



7. Entropy production bounds 

In this section, we prove Theorem 3 We first construct initial data / for the 
Boltzmmann-Kac equations that has low entropy production. We then show that 
this implies that the /df-chaotic family of initial data for the Kac master equation 
also has low entropy production. 

Given two probability densities / and g on the line M, define 

(/ ° = 77- / / f{cos{9)v - sm{9)v^) g{sm{9)v + cos{9)v^)d9dv^ . 
Jo 

The density f o g is called the Wild convolution of / and g, and using it we may 
write the Boltzmann-Kac equation in the compact form 



(44) 



d 



Any rescaling of ■y{v) is an equihbrium solution of this equation: For any a > 0, 
define 

Ma = {27ra)-^/^ exp(-vy2a) = a-^^^-fia-^^h^) . 

There are the so-called Maxwellian densities, and one easily sees that for all a > 0, 
Ma o Ma = Ma, SO that these are stationary solutions of (jH]). 

For any zero mean, unit variance solution / of (jH]), the relative entropy with 
respect to 7 satisfies 

_ d_ 

~ di' 



(45) 



-H{f\l)= [ {-\nf)[fof-f]dv. 
Jr 



The analog of the Boltzmann iJ-Theorem for the Boltzmann-Kac equation asserts 
that this quantity is strictly positive unless / is one of the Maxwellians, in which 
case it is zero. 
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Our first goal in this section is to construct, for each c > 0, zero mean, unit 
variance initial data / for which 



[ (-ln/)[/o/-/]dt;<cif(/|7) 



There is a very natural construction that has been exploited by Bobylev and 
Cercignani [1] in the case of the actual Boltzmann equation: Use a superposition 
of two very different Maxwellians. This is natural since each Ma is an equilibrium 
solution. (In the case of the actual Boltzmann equation there is an even larger class 
of equilibrium densities to work with since momentum is also conserved. Here, only 
centered Maxwellians are equilibrium solutions.) 

Pick a small positive number 6, and define 

(46) f = il-6)Ma + SM, 
where 

(47) b = 1/(25) and a = 1/(2(1 - 6)) . 
Then^ince / M.d„ = 1 and / „^Af>, = 



[ v\l- S)Madv = I v'^SMbdv = - 
Jr Jr 2 



so that each Maxwellian component contributes half of the energy, though for small 
6, most of the mass is contained in the Ma component. 

Proposition 23. For any c > there is a probability distribution / on M such that 
J v'^f{v)dv = 1 and 

H(fh) - ' 

where D{f) = J^{— In/) [/ o / — f]dv is the entropy production for the Boltzmann- 
Kac equation. Moreover, f can be chosen smooth with finite moments of all orders, 
in fact a linear combination of Gaussian functions. 

Proof of Proposition [23. Define / = (1 — 6)Ma + SMb as above. We first show that 
H{f\'~f) is bounded away from uniformly for all S sufficiently small. In fact, 

(48) limi7(/|7) = i^. 
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To prove ( l48l) , we use the definition of / and tlie monotonicity of tlie logaritlim: 
j f\n(^^^dv = {1 - S) J Main (J-^ dv + 6 j Mhln (^^^ dv 

> (l-*)/M„,„((i^i)^)l + ^/M.ln(^^*)d„ 

= (1-5) ln(l - 5) + (1 - 5)H{Ma\-f) + S\nS + SH{Mi,\-f) 
= (l-(5)ln(l-5) + (5In(5 + i(ln2-5 + 51n(25)) , 

where the last equahty follows from the formula H{Mc\'j) = -(c — 1) Inc. This 

2 2 

implies f HS]) at once. 

It remains to estimate the entropy production associated with /. First, 

/ o / = (1 - 5)2m, + 6^M, + 25(1 - 6)Ma o M, . 

Therefore, 

[ {-\nf)[fof-f]dv = {S-S^) [ i-\nf)[2MaoM,-iMa + M,)]dv . 
Jr Jr 

Next, use the fact that for all 6 < 1, {— In /) > 0. Hence, we can simplify, obtaining 
[-\nf)[fof-f]dv<26 [ {-\nf)MaoM,dv . 



By monotonicity of the logarithm. In / > ln(5Mfe) so that 

(-In/) < -^{\n6 -Irni) + 6v^ . 



n) + 26' 



Hence we have f (— In /) [/ o / — f]dv < 26 ( — (In 5 — In : 
Jr V 2 

Evidently, the leading term is —6 In 6. So 

(49) lim/(-ln/)[/o/-/]dt; = 0. 

The combination of PHI) and fHOj) implies Proposition [23] at once. □ 

Remark 24. The distribution / constructed above do not have uniformly bounded 
fourth moment. In fact, the ratio of / v'^fdv to J v^Mdv tends to infinity like 1/6. 

Now we shall deduce Theorem [3] from Proposition 
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Proof of TheoremlM Let c > 0, and let / be defined by Proposition [231 Let further 
pN _ [/®^]^jv-i(^). Tfieorem [9] guarantees tliat — — > H{f\'y). Tlius, it 



suffices to establish 



N 



2 / (-ln/)[/o/-/]d^. 



N 



k=l 



To prove ([7]), we first write logF''^ = In Z^{f, \/N) + log f{vk), and hence 
-(L^(F^),ln(F^))^2(g^^_l(^)) is given by 

N 

N {QF'' - F^) da' 



5Af-i(v^) 



k=l 



X 



5Af-i(v/7V) 
N N 

EE 

k=l i<j 
1 

2^ 



ln(Z^(/, v^) + ^log/K) 

"^^OgfiVk 

log/K) 



k=l 



N {QF'' - F^) da' 
2 



A^- 1 



27r 



{f'^''{Ri,,eV) - f^'^iV)) de 



1 



ZNif, VN) 



■da 



AT 



(50) 

By the invariance of under rotations, the integral over S^^^{^/N) vanished 
unless k = i OT k = j. By the permutation symmetry, we may set /c = 1, and 
account for the sum over k by multiplying by A^. There are — 1 pairs of which 1 is 
a member. We may set i, j = 1, 2, and account for the sum over pairs by multiplying 
by — 1. We are then left with 

(51) 2Ar / log/(t;,) r U Wi) f {v'^) - f {^i) f {^2)) dO 



N 



X 



where v[ = cos(6')f 1 + sin(6')?;2 and v'2 = — sin(6')t;i + cos(6')t;2- 

Since / is a linear combination of Maxwellian densities, there is a constant C such 
that I log/(t;)| < C{l+v^). Then again since / is a linear combination of Maxwellian 
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log/M (/K)/K)-/K)/(^2)) 



densities 
decay. 

The proof will be completed by showing that 

N 



is bounded, and in fact has Gaussian 



Since, with s"^ = vf + 



lim P2 ( TT f^^M^"" 1 = d^;idt^2 . 



U7v(/,v^)f_v ' ; ^iv(/,v^) 



TV 

it remains only to show that 

(52) lim ^^"^^^'^"^^ = 2vre(^?+^i)/^ 

since it is well known, and easily follows from ([7]), that 

lim Psfdcr^) = — e-("'+"2)/2dt;idt;2 . 

However, (!52l) easily follows from Theorem [Hand Stirling's formula. □ 

Remark 25. We have taken advantage of Maxwellian bounds on / to shorten the 
proof, but a similar result could be obtained in the same way for more general 
densities / by arguing as in the proof of Theorem [201 A more challenging problem 
would be to prove an analog of Lemma [7] for a more general class of chaotic data 
than conditioned tensor products. 

Appendix A. An entropic Local Central Limit Theorem 

The terminology "Local Central Limit Theorem" is used to designate a version 
of the Central Limit Theorem in which the conclusion is strengthened from weak 
convergence of the law to locally uniform pointwise convergence of the densities [12] . 

As recalled in the introduction, such a theorem can only hold if the common law 
of the independent random variables has a density / that satisfies certain regularity 
hypotheses — in particular, / is usually require to belong to LP for some p > 1. 

Of course the rate of pointwise convergence depends on the regularity of /. In 
this paper, we require precise, quantitative information on the rate, and the version 
of the Local Central Limit Theorem that we prove here provides this. 
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There is a remarkable feature that emerges: When an bound is imposed on /, 
then the asymptotic rate of (pointwise) convergence of the densities y/N f*^ [y/Nx) 
to the Gaussian distribution can be estimated in terms of only the relative entropy 
H{f\'j), even if the assumption H{f\'j) < oo alone is not sufficient to ensure the 
convergence! Of course, the bound on / enters the estimates of convergence, but 
only in determining how large N must be before the universal rate estimates governed 
by H{f\'-f) become valid. For this reason, we refer to the result obtained here as an 
Entropic Local Central Limit Theorem. 

In addition to the bound on /, one requires a certain measure of localization 
of f{v)v^dv, which is usually taken care of in the assumptions by assuming that 

(53) [ f{v)v^-^'dv < oo 



for some e > 0. 

So that we may include all finite energy initial data in our conclusions, we wish 
to avoid such an assumption. For this reason, we introduce the function 

X{r) = / \x\^f{x)dx . 

This is a continuous function vanishing at r = 0, and the rate at which it vanishes 
as r -^^ gives the sort of control that would be provided by flS51) . Indeed, under 
the assumption (l53ll . 

X(r) = O(r^) . 

Before beginning the proof, we note that in this Appendix the state space is M'^, 
where k is some positive integer. All the constants in our results may depend on k, 
but this dependence will not be explicitly recalled. 

We start by some properties of the Fourier transform of probability densities. In 
the sequel, we use the following convention for the Fourier transform in M'^: 

m= I e-''-^^f{x)dx. 
Proposition 26. Let g be a probability density on M'^, such that 

xg{x)dx = 0, / {x^x)g{x)dx = Ik, / ^'log^'dx < H < +oo, 
where Ik is the k x k identity matrix. Let further x be such that 

\x\'^g{x) dx < 
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where xi'f') goes to as r ^ 0. Then 

(i) Given r] > there is a = a^H.rf) > such that 

\i\>ri^ |?(OI<l-«. 



(ii) There is a function e{5) = e{H, x, 6), going to as 6 0, such that 

iei<5^ \9{0-{i-2^'m\<e{m\'- 

(Hi) There is = ao{H,x) such that 

Proof. First, it is clear that [Hi) follows from (i) and (ii). For simplicity, we shall 
prove (z) and [ii) only in the case k = 1; the generalization to higher dimension does 
not bring in any major complication. 

Let us prove (i). Let ^ be such that |,^| > rj, and let z be such that ^(,^)e~^*'^^^ = 
|^(^)|. Then, with 3? standing for real part, 

m)\ = '^[diOe-'''''^] 

3? ( / ^(x)e-2^'^(^+")« dx 



g{x) cos[27r(x + z)^] dx. 
Let > 1, to be chosen later. Write 

l?(OI = f g{x)dx - j g{x){l - cos[2'k{x + z)i]^ dx 
1—1 g{x)(^l — cos[27i{x + z)^]j dx 



< 1 



So it is sufficient to show that 



■R,R] 



g{x) {l — cos \2tx[x + z)^]^ dx. 



I g{x)(l - cos[2'k{x + z)^]) dx > a > 0. 

J[-R,R] ^ ^ 
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Let {3 G (0, 1/2), to be chosen later; define 

5:= |xG 1 -cos[27r(x + ^)^] < /j}. 

The point is to show that g is small when (3 is small too. For this we shall show 
that B has small Lebesgue measure and use the entropy bound on g. 
If X lies in B, then Ixl < R, and there exists n G Z such that 



n 



X — 



< 



cos 



2vr|el 



So B consists of at most 2i?|^| + 3 intervals, with width cos~"^(l — f3)/{n\^\), which 
can be bounded by v^2^/(7r|^|). So the Lebesgue measure \B\ oi B can be estimated 
as follows: 



\B\ < 

(54) 
Now define 

fi{dx) = 
By direct computation. 



f2R\^\ 



2/3 < 



< 



2R 

IT 

2R 

7T 



1 + 
1 + 



g{x)li-R^R]{x) dx 



I, 



vi^dx) 



1 
1 

7] 

1[- 



2(3 
2~p. 

(x) dx 



R,R\ 



2R 



glogg + \og{2R) - log 



■R,R] 



< / ^7|log^7|+log(2i?)-log 1- 



R,R] 

R 



where we have used Chebyshev's inequality to get the bound on the last term: 
I\x\>r9 — (V-^^) / gx^dx < 1/ R?. It is classical that / g\ \ogg\ can be controlled by 
J glogg and / gx'^dx = 1: indeed, if 7 stands for the standard gaussian distribution, 
then 

olog--^ + 7) > 0, 



9<1 



so 



glogg > 



3<1 



7 

ghg'y 



9<1 



7; 



9<1 
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replacing log 7 by its explicit expression, we obtain 

log(27r) 

—yyx) ax- ^ i - 



Jg<l J g<l ^ \ ^ / J g<\ Jg<l 



> 



log(27r) 



The desired bound follows, since 



9\^ogg\ = I g\ogg-2 / glogg. 

J Jg<l 

To summarize: there is an explicit bound 
(55) H{fi\u) <h{H,R). 

On the other hand, it follows from (1541) that 



1 



TT 



iy[B] < - 1 + - V2p. 



Combining this with ( !55l) and a general entropy inequality, we find 



m < 



log 1 



1^1 B] 



< 



log 1 



irh 



So if H and 77 are given, there is a function m{j3), going to as /3 ^ and depending 
only on H and rj, such that fi[B] < m(/3). 
The desired conclusion follows easily: 



/g{x)i 1 — cos[2tt{x + z)^]] dx > (3 / g{x)dx 
,-R,R] ^ ^ h-RM 



■R,R] 



g) [-/?,/?]] 



V J\x\>R J 



( 



2h 



FROM MICROSCOPIC TO MACROSCOPIC ENTROPY 



43 



This establishes (i) with 



a := sup /5 ( 1 — 



i?2 



1 - 



2/i 



log 1 + 



To get a lower bound on a, one may choose for instance 



i? = 2, i5 = e 



~8h 



2(1+7/^1)2 



then one finds a > -e 



'8h 



2{l + 7]~^)\ 

Now let us prove {ii). Assume for instance that ,^ > 0. By Taylor formula, 



1 - 2iiTxC - Att'^x' I (e - C) e"''™'^ dC 



= 1 - 2i'Kx^ - Att^x^ 
So for |,^| < T], one has 



giO - (1 - 27r2e2) 



with 



< 



47r2 
47r2 



(e-O ([l-e-2*-<]x2^(x)dx) dC 
( [\^-C)dc] (sup / |l-e-2*-^<|x2^(x)dx 



= 47r^ sup / I sin(7r^x)| dx. 

\C\<riJ 

For |x| < 1/r and |C| < r/, one has | sin(27r(^a;)| < |27rCx| < 2TTri/r\ on the other 
hand, for |x| > 1/r, we can use the trivial bound | sin(7rCx)| < 1. Therefore, 



27r?7 



x^g{x) dx 



\x\>l/r 



27rr7 



X g{x) dx < h 

|z|>l/r 
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In conclusion, e < inf 

r>0 



27r?7 , , 
- + X{r) 



, and the right-hand side goes to as 77 —> 0. 

This proves (ii). □ 

Now we can proceed with the main result of this Appendix. 

Theorem 27 (Local Central Limit Theorem). Let g he a probability distribution on 
M*^, satisfying 

/ g{x)xdx = 0, / g{x){x CB) x) dx = Ik, / g\oggdx<H, 

where Ik is the k x k identity matrix. Let x be such that x(^) as r ^ 0, and 
g{x) dx < x{^)- Let further gN{x) = \fN g*'^ {\/Nx) , for any positive integer 
N. Then: 

(i) If g G Lp(]R'^), 1 < j9 < 00, then g^ is continuous for N > p' = p/{p — 1); and 
for any 6 > there is a = a{x, 11,6) > and e = e{x, 11,6) > such that, given k, 
X and H , e{6) > and, for N > p' , 

snp\gN{x)-j{x)\<VN{l-a)''-P'\\g\\t + k^=- + m, 

where 7 stands for the standard Gaussian distribution. In particular, sup \gN — 7I 
goes to as N ^ 00, and there is an upper bound on the rate of convergence which 
only depends on k, p, \\g\\LP, X o'^^ H. 

(ii) Given x (^nd H there is a function X{N), going to as N ^ 00, such that if 
g lies in for some p G (1, 00), then there is Nq = Nq{x, H, N,p, with 

N>No^ sup l^fTv -7I < A(iV). 



Remark 28. Part (ii) of this theorem is not used in this paper, but it is worth 
noticing in our "entropic" context: It shows that there is a universal bound on the 
asymptotic rate of convergence, depending only on energy and entropy estimates, 
and independent of any bound. Still the bound provides an estimate of the 
integer N for which the estimate starts to be valid. We do not know whether this 
information might be useful to obtain appropriate versions of the Local Central 
Limit Theorem which do not rely on estimates. 

Proof of Theorem 27 First, it follows from Young's convolution inequality that g*(^~^^ 
lies in (M^); then its convolution product with g is continuous. 
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By properties of the Fourier transform, 

9NiO = 9 



N 



Without loss of generahty, assume p < 2; then 'g{-/\fN) hes in L^' fl by the 
Hausdorff- Young inequahty, so g]q hes in for N > p'. Then the Fourier inversion 
formula applies: 

9n{x)= [ ^(Oe^^'^^-^de 



In particular, for any x G . 

\9n{x) -i{x)\ 



< 



Ifi-A^ -7l 



We separate between low and high frequencies, according to some threshold dvN, 
to choose later: 



(57) 



sup \gNix) - 7(a;)| < 



\ii\>5VN 



\9n\ 



h\ 



\9n - 7l 



To estimate the first term in the right-hand side of (1571) . we use Proposition [261 (i) 
there is a = a{6, x,H)>0 such that |.^| > ?7 = 



\i\>Sy^ 



\9n\ 



TV 



\9{0 \ < 1 - a; so 

-k 



\i\>SVN 



N 



\9\ 



Combining this with the Hausdorff- Young inequality, we find 

, , , , k 

(5" 



\g^\<VNil-af-P'\\g\\l,. 



'\C\>WN 

The second term in the right-hand side of fl571) can be bounded by an explicit 
estimate: 



SVN 



iei>5vW 

The third term in the right-hand side of fl57|) is a bit more subtle. On one hand, 
by a telescopic sum argument, since lol < 1 and < 1, we have 
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Now we can apply Proposition [26] (ii) . with replaced by C,/yN and e = max(eg, e^) 
where Eg is the function appearing in the Proposition: 



(59) 



7(0 



N 



7 



< N 



N 

< 2Ne{6) 



+ 



N 



2e{5)e 



Here e is a function depending only on H and x- 
On the other hand, by Proposition [261 (iii), 



1^(0 -7(01 < 



9 



N 



l{C) ^ niax I 1 



N 



N 



l-tto +7(0- 



Thanks to the inequality (1 — u/N)^ < e we conclude that 
(60) 1^(0- 7(01 <max(e-'l«^ (l-aof)+m 



<2max(^e-'^'l«l', (1 - ao)"^ 



By taking the geometric mean of (l59l) and ([601) . we obtain 

\g{0 - 7(01 < 10 max(e-^, (1 - ao)^) • 



Then 



|?(0-7(OI<V2e 



< V2e 



< V2e 



lOe- 

lOe- 



10 



de + (1 - ao) 



10 



de + (i-«o)^i^-'('^)"^ 



de +C(A;,ao; 



' k + 1 



(where C(/c, Oq) is a constant which does not depend on N). This concludes the 
proof of (i). 

To prove (ii), we let p vary with in such a way that p remains of the order of 
A^; for instance, p' = N/2 (for large enough). Then, as goes to infinity. 



loglkliLP 



p — 1 



log / 9 



9^ogg. 
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So, when is large enough, the first term in the right-hand side of (i) can be 
bounded by (1 — a)^^'^e^ , which does not depend on the norm of g. (But "large 
enough" here may depend on this norm!!) □ 
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